INTERACTIVE MULTIMEDIA VIDEO DISTRIBUTION SYSTEM 



This application claims benefit of U.S. Provisional Application No. 60/172,449, filed 17 
December 1999. 

Field of the Invention 

The present invention relates generally to the field of video communications technology. 
More specifically, this invention is directed to a method and system for dynamically and 
remotely accessing local and wide area elements real-time and interfacing with an end-user 
population. 

Background of the Invention 

There is an ever-growing need for real-time access, control, and delivery of live video 
images with audio and data for face-to-face discussions and interactive multimedia applications 
by means of uni-directional and bi-directional transmission of images and sounds across a 
variety of transmission medium and schemes. 

Presently, the technology available suffers from limitations in transmitting large 
bandwidth applications, such as transmitting video over a network and also at the same time, 
being able to combine existing components in this field to allow flexible, cost effective means to 
create a centrally managed system that guarantees high-quality, interoperable, open-architecture, 
delivery and distribution system. Most of the existing methods to support real-time video, audio, 
and multimedia images require a relatively proprietary or closed-architecture approach to deliver 
high bandwidth or interactive communication sessions. Additionally, these systems require the 
selection of either routing of special coax cables and additional wiring for video delivery or by 



utilizing bandwidth on data networks, such as, but not limited to, Ethernet, ATM and Token 
Ring. 

One such prior art system is disclosed in U.S. Patent No. 5,509,009 to Laycock et al. A 
dial-up aural and visual communication system includes a telecommunication network with a 
switch connected thereto, a codec subsystem connected to the switch and video equipment 
connected to the switch via the codec subsystem with voice communication equipment 
connected directly to the switch. The codec subsystem is shared between several end users and 
can be located near the switch. Sharing the codec reduces cost and amount of equipment at end 
users desk. The codec subsystem can also switch video, including composite video, between 
local lines and can include frame and storage. The codec can transmit at 9.6 kbps, px64 kbps, 
and via ISDN. The system can be used for video conferencing, remote surveillance or desk-top 
services, and can include an image grooming system. Images may be stored in switch facilities 
traditionally used for voice mail. 

Another prior art system is disclosed in U.S. Patent No. 5,014,267 to Tomkins et al . 
communications networks for interfacing between remote video terminals is that provides video, 
audio and data paths there between. The video terminals transmit and receive video, audio and 
data information through the network. The network includes a centrally disposed switching 
network for receiving audio and video information on one of a plurality of audio/video ports and 
selectively interconnecting this information to one or more of the remaining audio/video ports. 

U.S. Patent No. 5,534,914 to Flohr et al discloses a videoconferencing network for digital 
computer workstations that operate on a local area network (LAN) to exchange data. The 
network includes a signaling local area network (A-LAN), connected to a first port of a plurality 
of workstations, for transmitting and receiving data signals between selected ones of the 



workstations and a broadband local area network (B-LAN) connected to the second port of the 
plurality of workstations, for transmitting and receiving television signals between selected ones 
of these workstations. Each television signal is transmitted at a selected frequency channel so 
that no two transmissions interfere. A software program, stored in and operable on the computer 
of each workstation, generates and receives data messages, transmitted via the (A-LAN), to and 
from the computer of another workstation, respectively. These data messages initiate and control 
the transmission of the television signals on the (B-LAN) such that a plurality of television 
signals are assigned to a separate frequency channel. The software program in each computer 
monitors the status of the chaimel allocations and generates the channel selecting control signals. 

U.S. Patent No. 5,621,455 to Rogers et al discloses an apparatus and method is provided 
for modulating and transmitting fiiU-motion, television-quality color video signals along with 
digital data signals over a pair of ordinary unshielded twisted pair telephone wires without 
interfering with normal telephone data on the wires without interfering with normal telephone 
data on the wires. The invention is characterized by a transmission method involving frequency 
modulation of a baseband video signal and subsequent signal filtering to suppress an upper 
sideband corresponding to a color component of the original video signal. The filtered signal is 
received from the telephone wires at a different location, filtered, demodulated and provided to a 
display device. Full-duplex operation over the same pair of wires is possible, such that two 
video signals may be simultaneously transmitted, each signal having an approximate bandwidth 
of 6 MHz and shifted to a desirable non-interfering frequency location within the approximately 
20 MHz of usable bandwidth on the telephone wires. No pre-emphasis or de-emphasis is 
required to achieve good quality video transmission. The system has many applications 
including video distributions, conferencing, and communications. 
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However, these prior art devices are limited by what communications methods are 
available, what infrastructure is in place, what type of platforms are on the PCs or workstations, 
what format the video or audio is in (digital or analog) nor what network is being used (Ethernet, 
Token Ring, ATM, etc.) 
5 Summary of the Invention 

The foregoing limitations and disadvantages of the prior art are overcome by the present 
invention. This invention provides for an Interactive Multimedia Video Distribution System, 
that is as centrally manageable system that can utilize various methods, such as digital or analog, 
to deliver the best-quality video to and from single or multiple elements within the system. This 
1©= invention also offers a folly adaptable communications system by utilizing both RF and/or IP for 
Q delivery of any content including voice, video and data. The present invention is an open- 
r-y architecture based solution that realizes cost savings in multiple facets. 

i^ri The IMVDS of the present invention delivers all the traditional features, including access, 

I* control and monitormg of remote cameras, with added benefits for interactive visual 
l%2 communications, including video conferencing, multicasting, broadcasting, data collection and 
jJ data transfer. This platform eliminates the requirement of routing special coax cables and 
additional wiring for video delivery, by utilizmg existing network cabling and by interfacing 
v^th existing cameras and equipment. Therefore, implementation costs associated with 
expensive cabUng and network installations normally incurred in renovation and reconstruction 
20 are minimized. The open architecture system of the present invention utiUzes software driven 
control graphical user interfaces (GUIs) based on a standard Microsoft WindowsTM or similar 
platform. The video quality of the present invention is guaranteed from remote sites based upon 
the bandwidth utilized to send video images from the remote cameras or devices. The system of 
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the present invention eliminates the bandwidth bottlenecks associated with traditional systems by 
utilizing available infrastructure wiring instead on running video on the data network. The 
present invention also utilizes the existing infrastructure such as cameras, encoders, modems, 
etc., thereby eliminating extra costs. 
5 The present invention provides on-demand dial, control and view of multiple cameras. 

The present invention provides controlled access, security ftinctions and video sharing 
capabilities with other users. The present invention also provides on-board video conferencing 
capability, remote management capability and priority level and control management. 
Additionally, the present invention is standards based, provides real-time access of multiple 
10^; cameras and maximizes the use of international standards such as H.320, H.323, H.324, H.32X, 
. 1 MPEG, etc., and commercial of-the-shelf products (COTS). 

iy The present invention implements tAvo of the most widely accepted forms of signal 

in processing, digital and analog, to maximize the flexibility and efficiency of the system. The 
1^ present invention combines IP (Internet Protocol) and RF (Radio Frequency) for delivering 
If j; content to and from devices and is flexible so that the specific application will benefit from either 
\^ method of signaling dependant upon all variables in their network. 
Brief Description of the Drawings 

The above and other advantages of the invention will be more clearly appreciated from 
the following detailed description when taken in conjunction with the accompanying drawings in 
20 which: 

Fig. 1 is a basic illustration a hardware configuration of a real-time system of the present 
invention. 
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Fig. 2 is a block diagram illustrating the hardware configuration according to the 
embodiment in Fig. 1. 

Fig. 3 is another embodiment of the real-time system of the present invention illustrating 
a typical IMTS layout. 



Fig. 5 is another embodiment of the real-time system of the present invention. 
Detailed Description of the Invention 

Fig. 1 illustrates a basic arrangement of the IMVDS (10). The system comprises a 
network communications central irtiit switch (102) that is capable of connecting at least 
113 approximately 256 endpoints, modems (110), video workstations (120, 130), data server (150), 
codec subsystem (170), VCR (106), multi-view device (104), videoconferencing system (112), 
J;: network interface (180) and monitor (106). Video workstations (120, 130) are capable of audio 
= and visual communications. 



13 to and from different ports. The data server (105) administers management of the present 
invention. The video workstations (120, 130) comprise hardware and software that controls the 
processing of data received. The application software at the video workstation controls the flow 
of data to and from the central unit switch (102) via a multimedia interface device and can 
20 communicate with any device or stations connected to the switch (102) such as a modem for 
transmitting data by, for example integrated switched digital network (ISDN) modem. 

Turning to Fig. 2, video workstation (120), remote camera (105), VCR/DVD, detection 
device (107) and the sensor (108) each communicate with the central unit switch (102) via any 
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Fig. 4 is another embodiment of the real-time system of the present invention. 



The central unit switch (102) is a bidirectical network communications hub and works by 



IS.^ routing RF modulated signals and is capable of carrying multiple audio, video, and data signals 
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known means such as RS232, Video (NTSC/PAL), audio or data. Video workstations (120, 130) 
access the central unit switch (102) via a modem (110). Video workstations (120, 130) are 
interactive and interoperable with each other through the central unit switch (102) and the data 
server (105) and with any other device in the network for the network for video communications. 
5 The video workstations (120, 130) include microphones and speakers for transmitting audio 
communications. 

The codec subsystem (170) may include any standards-based codecs including a 
multipoint control unit (MCU) system that is capable of housing several different codecs, in 
order to be able to provide a number of services for a number of different types of end uses. The 
IS^J codec subsystem (170) is in communication with the central unit switch (102). Numerous 
codecs may be installed within the subsystem (1 70), depending upon the service to be supported, 
ril codec subsystem (170) allows remote communication via the netvv^ork interface 

[r| (180). The network interface (180) provides an interface to communication network (190). 
U Communication network (190) may be multiple types of combinations of network architectures, 
11^ including ISDN, a wireless network, a LAN, a WAN, a Community Access Television Network 
O (CATV), the Internet, an ATM network, Tl and the Public Sv^itched Telephone Netwo± 
(PSTN). However, it will be apparent to those skilled in the art that other types of 
communications protocols are suitable for use with the present invention. 

The video splitter (104) is used to deliver multiple video images in a single display on a 
20 single computer monitor simuhaneously, without an external monitor or video displays. Modem 
(1 10) is used as a switch extender to allow communication in excess of 25 ft. The data server 
(150) provides standardized database ftmctioning and flexibility. The data server (150) allows 
elements in IMVDS architecture of the present invention to function including the management 
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capability, system status, and all IP communication to and from different ports, including the 
video stations and the central unit switch (102). Data may also be stored in the data server for 
different applications such as a database. 

The network communications central unit switch (102) is, for example, a multifunction 
broadband switch that delivers two-way, full-motion video having audio and high-speed data 
communications capabilities. The central unit switch (102) delivers multimedia communications 
using twisted pair wiring or the like. The central unit switch (102) is compatible with digital 
analog and standards, such as ISDN. The data server (150) interfaces with the central unit switch 
(102) and the video stations (120, 130) in administration of the system. The data server (150) 
manages user priorities including database management and camera location information. The 
data server (150) connects the video workstations (120, 130) via IP or other connection. 

Referring now to Fig. 3, there is shown a diagram of another embodiment of the real-time 
video system of the present invention. The basic system layout includes the network 
conamunications central unit switch (102) connected to the data server (150) and video user 
stations (120) via modems (110), multi-view device (104), codec subsystem (170), and network 
communication device (116) gateway device (114). The video user stations are comprised of 
video workstations (120,130). The central unit switch (102) communicates to the remote system 
via conamunications network (180, 190). The remote system is comprised of network 
communications device (116), gateway (114), remote workstation (130) and data router (118). 
The video workstations (120, 130) also communicate to the remote system via WAN (190). The 
central unit switch (102) communicates to the remote cameras (105) thought codec subsystem 
(170), modems (110) and network (180). 
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Fig. 3, an example of an Intelligent Traffic Management System (ITMS) used in a 
Traditional Traffic Management Center (TMC), is a preferred embodiment of the present 
invention. In networked surveillance operations, when video data is sent from remote camera 
(104), for example a highway traffic surveillance camera, the dynamic real-tune images are 
5 transmitted to the various peripheral devices via the network switch (102). The switch 
determines to which device the video data is directed. If the video data or audio data (image or 
voice) is directed to video workstation (120), the data is processed by the interface via the 
modem and output to the video workstation. If video workstation (120) has command control 
and data to transmit to the remote camera (104) for controlling the operation of the camera, the 
1^!:J data is directed to the interface card and is sent via modem (110) to the network switch (102) 
which processes the data for communication with the remote camera (104). The maximum 
f y transport distance for the system disclosed in Fig. 3 is 2000 feet over Category 5 cabling from 
|[| the location of the video workstation due to RF cabling losses. For system requirements 
1 4 exceeding 2000 feet, a different configuration is required. The video quality received at the 
15=^ TMC is dependent on the bandwidth utilized to send video images from the remote cameras. 
The method of delivery may be via methods such as single or multimode fiber, integrated 
switched digital Network (ISDN) or telephone systems, Tl, E2 and PRI. 

Referring again to Fig. 3, the ITMS enables users to interact in real time with supporting 
agencies and organizations, such as fire and rescue centers, highway pati-ol and other 
20 transportation agencies, whether local, national or global, in sharing mformation to enhance 
surface transportation management and improve highway safety. Every user on the local or wide 
area network (LANAVAN) equipped with the ITMS software, commercial-off-the-shelf (COTS) 
video package, and appropriate interface card is able to dial, control and view remote highway 
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surveillance cameras. The system is capable of delivering both National Television Standards 
Committee (NTSC) and phase alteration line (PAL) video signals to the desktop. As 
requirements arise, real-time video conferencing is also possible with any other user on the 
network, while viewing live traffic on the same screen for consultation and discussion. This 
5 communications platform offers on-demand access and control of video, audio and data devices 
from a simple user desktop. 

As the need arises for other agencies and organizations to access live images from the 
world's highway systems, this unique traffic management technology will allow even smaller 
TMCs and jurisdictions to implement a cost-effective system. Major metropolitan city TMCs 
li3 will be able to support smaller surrounding jurisdictions, by acting as primary video management 
centers while maintaining full control over all surveillance cameras at all times. 
V:l The benefits of ITMS are the ability for any authorized personnel to monitor traffic 

I n situations vdthout having to leave the office, and being able to stay abreast of critical higlway 
U incidents more effectively, anytime, from anywhere. Another benefit of the ITMS solution is the 
IS^^ capability of allowing remote access from other locations to the TMCs video network by 
D implementing a gateway for WAN connectivity. 

As well as savings in equipment costs compared with typical traffic management 
systems, the ITMS realizes cost benefits by maximizing utilization of existing investments, both 
internal and external to the TMCs, Another great cost saving is operator training. The extremely 
20 user-friendly, intuitive-control GUI is based on a standard Windows platform; training required 
to facilitate the ITMS is therefore greatly reduced for personnel who are familiar with other 
windows applications. The user can simply follow on-screen help instructions to dial and control 
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highway surveillance and monitoring cameras. All the above-mentioned factors contribute to the 
realization of cost savings in implementing a PC-based ITMS solution. 

Referring to Fig. 4, there is shown a diagram representing another embodiment of the 
present invention. In this embodiment, the network communications central unit switch (102) 
controls at least two locations, Site 1 and Site 2. At Site 1, the central unit switch (102) 
communicates with video workstations (120,130) via modems (110). Although four video 
workstations are shown, the system is capable of supporting multiple workstations. The central 
unit switch (102) is also connected to multi-view devices (104). The video workstations 
(120,130) are connected directly to the data server (150). LAN switch (210) is connected to the 
central unit switch (102) and to modem (220). Modem (220) provides data communication 
between LAN switches (210). The central unit switch (102) is connected to modem (222). At 
Site 1, Modem (222) provides video/audio/data communication between Site 1 and Site 2 by 
communicating with another video/audio/data modem (222) located at Site 2. Remote video 
workstation (30) is connected to LAN switch (210) and to matrix switcher (240) via modem 
(222). Although only one video workstation is shown at Site 2, the system is capable of 
supporting multiple workstations. Matrix switcher (240) is connected to data splitter (250) thru 
decoder (175). Modem (223) is connected to data splitter (250) and transmitter (260). 

In a typical multimedia sessions, transmitter (260) receives video data from a field 
camera. The data is sent in compressed format to the decoder (175). The decoder (175) converts 
the data from digital to analog. The data is then sent to the matrix switcher (240). The matrix 
switch (240) routes the data to the central unit switch (102) via modem (222). Video 
workstations (120,130) then have access to the data. The video workstations located at Site 1 
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communicate with the remote video workstations. All workstations are capable of accessing and 
controlling all elements in system. Data Splitter (250) controls the data sent to the field cameras. 

Turning to Fig. 5, there is a hardware configuration of another embodiment of the real- 
time video system of the present invention. Fig. 5 shows data conferencing between two centers, 
Center 1 and Center 2. Center 1 has a network communications central unit switch (102), 
modems (110) video workstations (120,130), LAN switch (210), data server (150) and modems 
(220). Center 2 has a network communications central unit switch (102), fiber modems (220), 
multi-view devices (104), matrix switcher (240), controller workstation (244), switcher (243), 
SDU (245), decoder (175), modem (223), FADP (242), LG (241) and transmitter (260). The 
embodiment of Fig. 5 differs from that of Fig. 4 in that Center 2 is provided with another central 
unit svdtch (102). Trunking the two central switches doubles the capacity of the system. 

The present invention utilizes existing equipment that is commercially available by 
combining, interconnecting and arranging the equipment together to allow fully interactive (one- 
way, two-way and multi-way) and multimedia (audio, video and data) communication to occur. 
The present invention also utilizes a new combination of separate features such as video codecs, 
video switches, PCs, Network Interfaces, communication modems/devices, and video splitters 
and combines them into an interactive multi-media solution. 

The present invention is an open system architecture based on International 
Telecommunications Union (ITU) standards and commercial-off-the shelf products (COTS), 
which ensures that the system is capable of adopting many of the popular digital transmission 
formats, including M-JPEG, MPEGl and MPEG2. Once the real-time video data is brought into 
the TMC, the video data may be distributed via a building or campus LAN wiring for 
simultaneous viewing by multiple video workstations. The video distribution platform enables 
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delivery of real-time, uncompressed video over twisted pair or any unshielded twisted pair 
category 3, 4 or 5 cabling schemes. On networks utilizing category 5 cables, transmission is via 
the spare pair wires that are generally available on most networks. 

Although a remote virtual access system for automobile traffic video surveillance has 
been exemplified, the architecture described is capable of supporting other applications such as, 
intelligent surveillance, manufacturing plant monitoring, warehouse management systems, 
telehealthcare/telemedicine, distance learning, travel/hospitality, and surface transportation 
management centers. 

While this invention has been described with specific embodiments, many alternatives, 
modifications and variations will be apparent to those skilled in the art in light of the foregoing 
description. Accordingly, it is intended to include all such alternatives, modifications and 
variations set forth within the scope of the description. 
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